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Abstract 

Two series of binary observations Xi,Xi, . . . and j/i,y2, ■ • ■ are presented: at each time n £ N we 
are given x n and t/n. It is assumed that the sequences are generated independently of each other by 
two stochastic processes. We are interested in the question of whether the sequences represent a typical 
realization of two different processes or of the same one. We demonstrate that this is impossible to decide 
in the case when the processes are _B-processes. It follows that discrimination is impossible for the set 
of all (finite-valued) stationary ergodic processes in general. This result means that every discrimination 
procedure is bound to err with non-negligible frequency when presented with sequences from some of 
such processes. It contrasts earlier positive results on _B-processes, in particular those showing that there 
are consistent d-distance estimates for this class of processes. 

Keywords: Process discrimination, B-processes, stationary ergodic processes, time series, homogeneity testing 

1 Introduction 

Given two series of observations we wish to decide whether they were generated by the same process or by 
different ones. The question is relatively simple when the time series are generated by a source of independent 
identically distributed outcomes. It is far less clear how to solve the problem for more general cases, such 
as the case of stationary ergodic time series. In this work we demonstrate that the question is impossible to 
decide even in the weakest asymptotic sense, for a wide class of processes, which is a subset of the set of all 
stationary ergodic processes. 

More formally, two series of binary observations xi,xi, . . . and yi,y2, ■ ■ ■ are presented sequentially. A 
discrimination procedure D is a family of mappings D„ : X" x A"" — > {0, 1}, n G N, that maps a pair 
of samples (xi, . . . , a;„), (j/i, . . . , into a binary ("yes" or "no") answer: the samples are generated by 
different distributions, or they are generated by the same distribution. 

A discrimination procedure D is asymptotically correct for a set C of process distributions if for any two 
distributions Px,Py G C independently generating the sequences Xi,X2t-- and 2/i,y2j--- correspondingly 
the expected output converges to the correct answer: the following limit exists and the equality holds 



lim EL»„((a;i, . . . ,a;„), (yi, . . .,?;„)) = \ ? 



if Pi, = Py 

otherwise 



Note that one can consider other notions of asymptotic correctness, for example one can require the output to 
stabilize on the correct answer with probability 1. The notion of correctness that we consider is perhaps one 
of the weakest. Clearly, asymptotically correct discriminating procedures exist for many classes of processes, 
for example for the class of all i.i.d. processes, or various parametric families, see e.g. [21 (3; some realted 
positive results on hypothesis testing for stationary ergodic process can be found in [12l [13] . 

We will show that asymptotically correct discrimination procedures do not exist for the class of B- 
processes, or for the class of all stationary ergodic processes. This result for _B-processes is interesting in 
view of some previously established results; thus, in [10l[9] it is shown that consistent estimates of d-distance 
for _B-processes (see definitions below) exist, while it is impossible to estimate this distance outside this 
class (i.e. in general for stationary ergodic processes). So, our result demonstrates that discrimination is 
harder than distance estimation. The distinction between these problems becomes very apparent in view 
of the positive results of |13| . which show that consistent change point estimates and process classification 
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procedures exist for the class of stationary ergodic processes. The result of the present work also complements 
earlier negative results on i3-processes, such as fT4^ that shows that upper and lower divergence rates need 
not be the same for B-processes, and on stationary ergodic processes, such as [111 [51 [Tl [5]. that establish 
negative results concerning prediction, density estimation, and testing properties of processes. It is worth 
noting that B-processes are of particular importance for information theory, in particular, since they are 
what can be obtained by stationary codings of memoryless processes [71 |TS] . 

Next we briefly introduce the notation. We are considering stationary ergodic processes (time series), 
defined as probability distributions on the set of one-way infinite sequences A°°, where A = {0, 1}. We will 
also consider stationary ergodic Markov chains on a countable set of states; for now let the set of states be 
N. Any function f : N A mapping the set of states to A, together with a stationary ergodic Markov chain 
TO defines a stationary ergodic binary-valued process, whose value on each time step is the value of / applied 
to the current state of m. 

For two finite- valued stationary processes px and py the d-distance d{px,Py) is said to be less than e if 
there exists a single stationary process Vxy on pairs n S N, such that Xn, n € N are distributed 

according to px and yn are distributed according to py while 

Vxy{xiT^yi) <£. (1) 

The infimum of the e's for which a coupling can be found such that ([1]) is satisfied is taken to be the d- 
distance between px and py. A process is called a B -process (or a Bernoulli process) if it is in the d-closure 
of the set of all aperiodic stationary ergodic /c-step Markov processes, where /c G N. For more information 
on d-distance and i3-processes the reader is referred to [TOl [5] ■ 

2 Main results 

The main result of this work is the following theorem; the construction used in the proof is based on the same 
ideas as the construction used in JTj (see also [3]) to demonstrate that consistent prediction for stationary 
ergodic processes is impossible. 

Theorem 1 There is no asymptotically correct discrimination procedure for the class of B -processes. 

Since the class of S-processes is a subset of the class of all stationary ergodic processes, the following corollary 
holds true. 

Corollary 1 There is no asymptotically correct discrimination procedure for the class of stationary ergodic 
processes. 

Proof of Theorem\3i We will assume that asymptotically correct discrimination procedure D for the class 
of all B-processes exists, and will construct a B-process p such that if both sequences Xi and yi, i S N are 
generated by p then EZ)„ diverges; this contradiction will prove the theorem. 

The scheme of the proof is as follows. On Step 1 we construct a sequence of processes p2/c, Pd2k+i, and 
P«2fc+i, where k = 0, 1, ... . On Step 2 we construct a process p, which is shown to be the limit of the 
sequence p2fej fc S N, in c?-distance. On Step 3 we show that two independent runs of the process p have a 
property that (with high probability) they first behave like two runs of a single process poi then like two runs 
of two different processes p^i and p^i, then like two runs of a single process p2^ and so on, thereby showing 
that the test D diverges and obtaining the desired contradiction. 

Assume that there exists an asymptotically correct discriminating procedure D. Fix some e G (0, 1/2) 
and 8 G [1/2, 1), to be defined on Step 3. 

Step 1. We will construct the sequence of process p2fe, Pu2k+i, and pd2k+i, where A; = 0, 1, ... . 

Step 1.0. Construct the process po as follows. A Markov chain toq is defined on the set N of states. From 
each state i e N the chain passes to the state with probability 5 and to the state i + 1 with probability 
1 — 5. With transition probabilities so defined, the chain possesses a unique stationary distribution Mq on 
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the set N, which can be calculated explicitly using e.g. [T71 Theorem VIII.4.1], and is as follows: Mo(0) = S, 
Mo{k) = 5{1 — d)'', for all £ N. Take this distribution as the initial distribution over the states. 

The function /o maps the states to the output alphabet {0, 1} as follows: /o(*) = 1 for every i e N. Let 
St be the state of the chain at time t. The process po is defined as po = /o(st) for t G N. As a result of this 
definition, the process po simply outputs 1 with probability 1 on every time step (however, by using different 
functions / we will have less trivial processes in the sequel). Clearly, the constructed process is stationary 
ergodic and a B-process. So, we have defined the chain mg (and the process po) up to a parameter S. 

Step 1.1. We begin with the process po and the chain toq of the previous step. Since the test D is 
asymptotically correct we will have 

EpoxpoAo((2^i, ■ • -^xto), {yi, . . ■,yto)) < £, 

from some to on, where both samples Xi and yt are generated by po (that is, both samples consist of Is only). 
Let ko be such an index that the chain mo starting from the state with probability 1 does not reach the 
state fco — 1 by time to (we can take ko = to + 2). 

Construct two processes pui and pdi as follows. They are also based on the Markov chain mo, but the 
functions / are different. The function /„i : N ^ {0, 1} is defined as follows: fui{i) = /o(«) = 1 for i < fcg 
and /ui(i) — for i > ko. The function fdi is identically 1 (/di(*) = 1, * G N). The processes pui and pdi 
are defined as pui — fuiist) and pdi — fdi{st) for i G N. Thus the process pdi will again produce only Is, 
but the process pui will occasionally produce Os. 

Step 1.2. Being run on two samples generated by the processes pui and pdi which both start from the 
state 0, the test Z?„ on the first to steps produces many Os, since on these first fco states all the functions /, 
fui and fdi coincide. However, since the processes are different and the test is asymptotically correct (by 
assumption), the test starts producing Is, until by a certain time step ti almost all answers are Is. Next 
we will construct the process p2 by "gluing" together pui and pdi and continuing them in such a way that, 
being run on two samples produced by p2 the test first produces Os (as if the samples were drawn from po), 
then, with probability close to 1/2 it will produce many Is (as if the samples were from p^i and pdi) and 
then again Os. 

The process p2 is the pivotal point of the construction, so we give it in some detail. On step 1.2a 
we present the construction of the process, and on step 1.2b we show that this process is a i?-process by 
demonstrating that it is equivalent to a (deterministic) function of a Markov chain. 

Step 1.2a. Let ti > to be such a time index that 

^p.axpaiDk{{xi, ■ . ■,xt,), (yi, . . ■,yu)) > 1 - e, 

where the samples Xi and yi are generated by pui and pdi correspondingly (the samples are generated 
independently; that is, the process are based on two independent copies of the Markov chain mo). Let 
fci > fco be such an index that the chain m starting from the state with probability 1 does not reach the 
state fci — 1 by time ti. 

Construct the process p2 as follows (see fig. [T|). It is based on a chain m2 on which Markov assumption 
is violated. The transition probabilities on states 0, . . . , fco are the same as for the Markov chain m (from 
each state return to with probability 5 or go to the next state with probability 1 — S). 

There are two "special" states: the "switch" 82 and the "reset" R2. From the state fco the chain passes 
with probability 1 — i5 to the "switch" state 15*2. The switch iS'2 can itself have two values: up and down. If 
S2 has the value up then from S2 the chain passes to the state Wfco+i with probability 1, while if S2 — down 
the chain goes to dkg+i, with probability 1. If the chain reaches the state R2 then the value of S2 is set to 
up with probability 1/2 and with probability 1/2 it is set to down. In other words, the first transition from 
S2 is random (either to Uko+i or to dfep+i with equal probabilities) and then this decision is remembered 
until the "reset" state R2 is visited, whereupon the switch again assumes the values up and down with equal 
probabilities. 

The rest of the transitions arc as follows. From each state Ui, ko < i < fci the chain passes to the state 
with probability 6 and to the next state u^+i with probability 1 — S. From the state u^-^ the process goes 
with probability 5 to and with probability 1 — (5 to the "reset" state R2. The same with states rf^: for 
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Figure 1: The processes m2 and p2- The states are depicted as circles, the arrows symbolize transition probabilities: 
from every state the process returns to with probability 5 or goes to the next state with probability 1 — 5. From 
the switch S2 the process passes to the state indicated by the switch (with probability 1); here it is the state Uko+\- 
When the process passes through the reset R2 the switch S2 is set to either up or down with equal probabilities. 
(Here S2 is in the position up.) The function /2 is 1 on all states except Uko+i, . . . , Ufci where it is 0; /2 applied to 
the states output by 7712 defines p2. 




Figure 2: The process m'2. The function /2 is 1 everywhere except the states Uk^+i, ■ • ■ , Uk^ , where it is 0. 




ko < i < ki the process returns to with probability 6 or goes to the next state di+i with probability 1 — 6, 
where the next state for dk^ is the "reset" state R2. From R2 the process goes with probability 1 to the state 
fci + 1 where from the chain continues ad infinitum: to the state with probability S or to the next state 
ki + 2 etc. with probability 1 — 6. 

The initial distribution on the states is defined as follows. The probabilities of the states 0..ko,ki + 
1, fci + 2, . . . are the same as in the Markov chain toq, that is, 6{1 — 6y , for j — O..ko, fci + 1, /ci + 2, . . . . 
For the states uj and dj, ko < j < ki define their initial probabilities to be 1/2 of the probability of the 
corresponding state in the chain mo, that is m2{uj) = m2{dj) = mo(j)/2 = 6{1 — 6)'-> /2. Furthermore, if the 
chain starts in a state Uj, ko < j < ki, then the value of the switch S2 is up, and if it starts in the state dj 
then the value of the switch >S'2 is down, whereas if the chain starts in any other state then the probability 
distribution on the values of the switch S2 is 1/2 for either up or down. 

The function /2 is defined as follows: /2(«) = 1 for < i < kg and i > ki (before the switch and after the 
reset); /2(wi) = for all i, ko < i < ki and f2{di) = 1 for alH, fco < i < /ci. The function /2 is undefined 
on 5*2 and R2, therefore there is no output on these states (we also assume that passing through S2 and R2 
does not increment time). As before, the process p2 is defined as p2 = /2(st) where St is the state of m2 at 
time t, omitting the states ^2 and i?2- The resulting process s illustrated on fig.[TJ 

Step 1.2b. To show that the process p2 is stationary ergodic and a B-process, we will show that it 
is equivalent to a function of a stationary ergodic Markov chain, whereas all such process are known to 
be B (e.g. [1^). The construction is as follows (see fig. [2]). This chain has states fci + 1, . . . and also 
Mo, . . . ,Uko,Uka+i, ■ ■ ■ ,Uki and do, . . . ,dko,dko+i, . ■ . ,dki. From the states Ui, i = 0, . . . ,ki the chain passes 
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with probability 1 — ^ to the next state Uj+i, where the next state for u^j^ is fc + 1 and with probability S 
returns to the state uq (and not to the state 0). Transitions for the state do, ... , dk^-i are defined analogously. 
Thus the states m^. correspond to the state up of the switch ^2 and the states dk^ — to the state down of 
the switch. Transitions for the states k + 1, k + 2, . . . are defined as follows: with probability 5/2 to the 
state uo, with probability to the state do, and with probability 1 — 5 to the next state. Thus, transitions 
to from the states with indices greater than ki corresponds to the reset i?2. Clearly, the chain 
defined possesses a unique stationary distribution M2 over the set of states and Ivhii) > for every state 
i. Moreover, this distribution is the same as the initial distribution on the states of the chain mo, except 
for the states ut and di, for which we have m^iui) — ■m'2{di) = mo(i)/2 = 5{1 — 5y /2, for < i < fco- We 
take this distribution as its initial distribution on the states of m'2. The resulting process m'2 is stationary 
ergodic, and a i?-process, since it is a function of a Markov chain [T^. It is easy to see that if we define the 
function /2 on the states of m'2 as 1 on all states except Uko+i, ■ ■ ■ , u^^, then the resulting process is exactly 
the process p2- Therefore, p2 is stationary ergodic and a -B- process. 

Step l.k. As before, we can continue the construction of the processes p„3 and p^a, that start with a 
segment of p2- Let t2 > ti be a time index such that 

where both samples are generated by p2- Let fc2 > be such an index that when starting from the state 
the process TO2 with probability 1 does not reach fc2 — 1 by time ^2 (equivalently: the process m'2 does not 
reach k2 — I when starting from either 0, uq or do). The processes p^s and pds are based on the same process 
7712 as p2. The functions /„3 and fds coincide with /2 on all states up to the state ^2 (including the states 
Ui and di, ko < i < ki). After k2 the function /„3 outputs Os while fds outputs Is: fusii) — 0, fdsi^) = 1 for 
i> k2. 

Furthermore, we find a time > t2 by which we have Ep^^gxp^ji^ts > 1 — e, where the samples are 
generated by pus and pdz, which is possible since D is consistent. Next, find an index fca > ^2 such that 
the process m2 does not reach k^ — 1 with probability 1 if the processes p„3 and p^a are used to produce 
two independent sequences and both start from the state 0. We then construct the process pA based on a 
(non-Markovian) process m^ by "gluing" together and after the step fca with a switch Sa and a reset 
Ra exactly as was done when constructing the process p2- The process 7714 is illustrated on fig. [3K). The 
process 7714 can be shown to be equivalent to a Markov chain 7714, which is constructed analogously to the 
chain 7712 (see fig. ^p). Thus, the process pa is can be shown to be a i?-process. 



Figure 3: a) The processes 7714. b) The Markov chain 7714 

Si ^ 1 /4 = 




/4 = 1 /4 = 1 



Proceeding this way we can construct the processes p2j, Pu2j+i and pd2j+i, j S N choosing the time steps 
tj > tj-i so that the expected output of the test approaches by the time tj being run on two samples 
produced by pj for even j, and approaches 1 by the time tj being run on samples produced by p^j and pdj 
for odd j: 

Ep2jxp2j < e (2) 

and 

Ep„2j + lXpd23 + l Asj + l > (1-e)- (3) 
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For each j the number kj > kj^i is selected in a such a way that the state kj — 1 is not reached (with 
probabiHty 1) by the time tj when starting from the state 0. Each of the processes p2j, Pu2j+i and Pdj2+i, 
j G N can be shown to be stationary ergodic and a i3-process by demonstrating equivalence to a Markov 
chain, analogously to the Step 1.2. The initial state distribution of each of the processes pt,t e N is 
Mt(k) = 5{1 - 5)^ and Mt{uk) = Mt{dk) = 5{\ - 5)^/2 for those fc G N for which the corresponding states 
are defined. 

Step 2. Having defined kj, j G N we can define the process p. The construction is given on Step 2a, 
while on Step 2b we show that p is stationary ergodic and a i?-process, by showing that it is the limit of the 
sequence p2j, j G N. 

Step 2a. The process p can be constructed as follows (sec fig. The construction is based on 

Figure 4: The processes rUp and p. The states are on horizontal lines. The function / being applied to the 
states of trip defines the process p. Its value is on the states on the upper lines (states Ufej^+i, . . . ,Ufe2j_i-i) 
where fc G N) and 1 on the rest of the states. 



/ = / = / = 




/ = 1 / = 1 / = 1 



the (non-Markovian) process rUp that has states 0,...,A;o, ^2^+1 + li • ■ • , ^20+1) i Wfe^^.+i, . . . , Wfcj^^j and 
dk2j+i, ■ ■ • , c'fc2j+i fo'^ j € N, along with switch states S2j and reset states R2j- Each switch S2j diverts the 
process to the state Uk2j+i if the switch has value up and to dk^j+i if it l^as the value down. The reset i?2j 
sets S2j to up with probability 1/2 and to down also with probability 1/2. From each state that is neither a 
reset nor a switch, the process goes to the next state with probability 1 — 5 and returns to the state with 
probability 5 (cf. Step Ik). 

The initial distribution Mp on the states of mp is defined as follows. For every state i such that < i < fco 
and fc2j+i < i < ^2^+2, j — 0, 1, ... , define the initial probability of the state i as Mp{i) — 5{1 — Sy (the 
same as in the chain mo), and for the sets Uj and dj (for those j for which these sets are defined) let 
Mpiuj) — Mp{dj) := (5(1 — Sy /2 (that is, 1/2 of the probability of the corresponding state of mo). 

The function / is defined as 1 everywhere except for the states Uj (for all j G N for which uj is defined) 
on which / takes the value 0. The process p is defined at time t as /(st), where St is the state of nip at time 
t. 

Step 2b. To show that p is a B-process, let us first show that it is stationary. To do this, define the 
so-called distributional distance on the set of all stochastic processes as follows. 

oo 

rf(/^l,M2) = ^W^\^J.l{{xl, . . .,XlB,\) = B.{) - p.2{{xi, . . .,XlB,\) = B^)\, 
i=l 

where pi,p2 are any stochastic processes, Wk ■= 2"*^ and Bi ranges over all tuples B G Uk^f^X'', assuming 
some fixed order on this set. The set of all stochastic processes, equipped with this distance, is complete, 
and the set of all stationary processes is its closed subset [4]. Thus, to show that the process p is stationary 
it suffices to show that linij^oo d{p2j,p) — 0, since the processes p2j, j G N, are stationary. To do this, it is 
enough to demonstrate that 

lim \p{{xi, . . . ,X|B|) = B) - P2j{{xi, . . .,x\B\) = B)\=Q (4) 

for each B G UfcgN-'f'^- Since the processes mp and m2j coincide on all states up to k2j+i, we have 
\p{xn ^ a) - p2j{xn ^ a)\ = \p{xi ^ a) ~ p2j{xi ^ a)\ ^< ^ Mp{k) + ^ M2j{k) 

k>k2j + l fc>fc2j + l 
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for every n €N and a G X. Moreover, for any tuple B G UkefiX'^ we obtain 

\piixi,...,x\B\) = B)~p2j{{x,,...,x\B\) = B)\<\B\l ^ Mp{k)+ ^ MyikU^O 

yfc>fc2j + i k>k2j+i j 

where the convergence follows from k^j oo. We conclude that ^ holds true, so that d{p,p2j) — > and p 
is stationary. 

To show that p is a i?-process, we will demonstrate that it is the limit of the sequence p2k, fc G N in 
the d distance (which was only defined for stationary processes). Since the set of all B-process is a closed 
subset of all stationary processes, it will follow that p itself is a i?-process. (Observe that this way we get 
ergodicity of p "for free" , since the set of all ergodic processes is closed in d distance, and all the processes 
P2j are ergodic.) In order to show that d{p, p2k) — > we have to find for each j a processes i^2j on pairs 
(xi, yi), {x2, 2/2), • ■ ■ , such that Xi are distributed according to p and yi are distributed according to p2j, and 
such that limj^oo i^2jixi =^ yi) =0. Construct such a coupling as follows. Consider the chains rrip and rn2j, 
which start in the same state (with initial distribution being Mp) and always take state transitions together, 
where if the process rrip is in the state ut or dt, t > k2j+i (that is, one of the states which the chain m2j 
does not have) then the chain m2j is in the state t. The first coordinate of the process V2j is obtained by 
applying the function / to the process vrip and the second by applying f2j to the chain m2j. Clearly, the 
distribution of the first coordinate is p and the distribution of the second is p2j- Since the chains start in 
the same state and always take state transitions together, and since the chains vrip and m2j coincide up to 
the state fej+i we have V2j{xi ^ yi) < J2k>k2j+i ^pi^) ~^ ^- Thus, d{p, p2j) 0, so that p is a i?-process. 

Step 3. Finally, it remains to show that the expected output of the test D diverges if the test is run on 
two independent samples produced by p. 

Recall that for all the chains m2j, m„2j+i and md2j+i as well as for the chain mp, the initial probability 
of the state is 5. By construction, if the process mp starts at the state then up to the time step k2j it 
behaves exactly as p2j that has started at the state 0. In symbols, we have 

Epy.p{Dt2, \s-^=Q,sl = Q) = Ep,^ xp., (A., 14 = 0, = 0) (5) 

for j G N, where sg and Sq denote the initial states of the processes generating the samples x and y 
correspondingly. 

We will use the following simple decomposition 

E(A, ) - S'E{Dt, K = 0, = 0) + (1 - <52)E(A, K ^ « or ^ 0), (6) 
([5]), and ^ we have 

Epxp(A.,) < (52Epxp(A., |sS = 0, 4 - 0) + (1 - S^) 

= 6'Ep,^ xp,^. (A., K = 0, sy = 0) + (1 - s') 

<Ep,^ xp., +(l-<5') <£ + (!- <52). (7) 

For odd indices, if the process p starts at the state then (from the definition of ^2^+1) by the time i2j+i 
it does not reach the reset R2j; therefore, in this case the value of the switch S2j does not change up to the 
time t2j+i- Since the definition of vrip is symmetric with respect to the values up and down of each switch, 
the probability that two samples xi, . . . , Xt^j^i and . . . , yt2j+i generated independently by (two runs of) 
the process p produced different values of the switch S2j when passing through it for the first time is 1/2. In 
other words, with probability 1/2 two samples generated by p starting at the state will look by the time 
^2j+i as two samples generated by Pu2j+i and pd2j+i that has started at state 0. Thus 

^^pxp(A.,+JsS = 0,s^ = 0) > ^i?p„.,+,xp..,^,(A.,+Jsg = 0,4 = 0) (8) 
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for j £ N. Using this, and ^ we obtain 




0) 




'P2j + 1 Xp2j + 1 



0) 




'P23+1 XP23+1 



(A^.^J-a--^^)) > 2('5'-£)- (9) 



Taking S large and e small (e.g. 6 — 0.9 and e = 0.1), we can make the bound ((7]) close to and the 
bound © close to 1/2, and the expected output of the test will cross these values infinitely often. Therefore, 
we have shown that the expected output of the test D diverges on two independent runs of the process p, 
contradicting the consistency of D. This contradiction concludes the proof. 
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